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METHODS AND APPARATUS FOR 
INDIRECT VLIW MEMORY ALLOCATION 

5 The present invention claims the benefit of U.S. Provisional Application Serial No. 

60/212,987 entitled "Methods and Apparatus for Indirect VLIW Memory Allocation" filed 
June 21, 2000 which is incorporated by reference herein in its entirety. 
Field of Invention 

The present invention relates generally to improved techniques for allocation of 

1 0 VLIWs in an array processor containing distributed indirectly accessed VLIW storage units, 
and more particularly to advantageous techniques for indirect VLIW memory allocation 
applicable to the manifold array (ManArray) multiprocessor digital signal processor (DSP). 
Background of the Invention 

The ManArray processor uses a very long instruction word (VLIW) architecture as a 

1 5 means to exploit instruction-level parallelism in an application program. In a VLIW 

processor, multiple execution units can operate in parallel and the execution units are directly 
controlled by corresponding instruction fields in the VLIW. Each field can contain a short 
instruction word (SIW) or native instruction to be executed on a specific unit concurrently 
with the instructions in other fields, thus achieving high performance. One of the drawbacks 

20 associated with many prior art VLIW processor architectures is that they are not scalable. 
VLIW processors require wide busses connecting instruction memory and execution units. 
These instruction busses must have the width of the VLIW to transport VLIW contents from 
instruction memory to the execution units. Consequently, as a VLIW is increased in width 
the instruction bus and program storage increases commensurately. Bus width can be a 

25 significant problem in multiprocessor architectures. 

Indirect VLIW is the solution employed for the BOPS ManArray digital signal 
multiprocessor family. It achieves the high performance afforded by executing multiple 
instructions packed in a very long instruction word (VLIW) and relaxes the requirements for 
the very wide instruction busses generally required. With indirect VLIW, the usual SIW size 

30 in program memory and the SIW bus width is maintained, at the expense of an additional 

small VLIW instruction memory (VIM) located near the execution units and the overhead to 
prepare the contents of VIM prior to execution. In essence, VIM acts like a programmer- 
controlled instruction cache. The VLIW instructions are loaded into the VIM using load 
VLIW instructions (LV) which consist of a delimiter instruction, the LV, followed by the 

35 instructions to be loaded into the VIM at a specific VIM address. 



Another advantage of the indirect VLIW approach is the fact that code that uses non- 
overlapping execution units can be compressed and folded into the same VLIW memory 
address containing another VLIW instruction. Thus, indirect VLIW not only avoids the 
explicit storage of non-operational place-holders (nop instructions), but also enables code 
compression by storing more than one non-overlapping VLIW in the same VIM line. 

When an application requires more VLIW instructions than the VIM size, one has to 
decide which VIM line and at which time a VLIW instruction is loaded into it. This decision 
is referred to as VIM allocation and requires the relocation of LV statements in application 
code. The need for VIM allocation and placement of LV statements arises in all back-end 
compiler tools that generate VLIW code, as well as hand-written assembly code. Code 
generators in compilers and assembly programmers in large software projects, only have a 
local or limited view of the whole program. Consequently, it is a difficult problem to know 
the requirements of the whole application program in order to efficiently allocate VLIWs in 
the VIM. 

Summary of the Invention 

Since the VIM is reprogrammable, the present invention addresses an approach in 
which a small VIM size may be used even when an application demands a number of VLIWs 
larger than can be fit into the physical VIM size used in a particular ManArray processor. 
With a fixed VIM size, load VIM latency, and knowledge of an application's requirements, 
the load VLIW VIM management instructions can be distributed appropriately in the 
application code. 

In one aspect of the present invention, a process and a set of heuristics are described 
to perform allocation of the special instruction memory where indirect very long instruction 
words (VLIW's) are stored for the ManArray family of multiprocessor digital signal 
processors. This work minimizes the cost of pre-initializing the contents of the VLIW 
memory prior to VLIW usage in the application code. The tool described here can handle 
multiple independent indirect VLIWs in the same VIM line. Further, this tool applies global 
optimizations that can be advantageously used on any compiler that generates indirect VLIW 
code. 

These and other features, aspects and advantages of the invention will be apparent to 
those skilled in the art from the following detailed description taken together with the 
accompanying drawings. 
Brief Description of the Drawings 

Fig. 1 illustrates a ManArray 2x2 iVLIW processor which may be suitably employed 
with this invention; 
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Fig. 2A illustrates a load VLIW (LV) instruction encoding; 
Fig. 2B illustrates a load VLIW (LV) instruction syntax and operation description; 
Fig. 3A illustrates an eXecute VLIW (XV) instruction encoding; 
Fig. 3B illustrates an eXecute VLIW (XV) instruction syntax and operation 
5 description; 

Fig. 4A illustrates a program section with load iVLIW (LV) and eXecute iVLIW 
(XV) instructions; 

Fig. 4B illustrates the program section of Fig. 4A after the load iVLIWs (LVs) have 
been relocated in accordance with the present invention; 
1 0 Fig. 5 illustrates a simplified program containing multiple XV usage requiring the 

pre-initialization of VIM for each XV; 

Fig. 6 illustrates a control flow graph for the simple program of Fig. 5; 
<*% Fig. 7 illustrates the control flow graph of Fig. 6 annotated with profile data in 

accordance with the present invention; 
S 1 5 Fig. 8 illustrates the control flow graph of Fig. 7 with the required XVs and with the 

%l allocated LV VIM pre-initialization based upon the profile data of Fig. 5 in accordance with 
|J1 the present invention; 

Fig. 9 illustrates a VLIW interference graph in accordance with the present invention; 

O and 

nj 20 Fig. 10 illustrates a greedy LV relocation process in accordance with the present 

^ invention. 

Q. Detailed Description 

Further details of a presently preferred ManArray core, architecture, and instructions 
for use in conjunction with the present invention are found in U.S. Patent Application Serial 
25 No. 08/885,310 filed June 30, 1997, now U.S. Patent No. 6,023,753, U.S. Patent Application 
Serial No. 08/949,122 filed October 10, 1997, now U.S. Patent No. 6,167,502, U.S. Patent 
Application Serial No. 09/169,255 filed October 9, 1998, U.S. Patent Application Serial No. 
09/169,256 filed October 9, 1998, now U.S. Patent No. 6,167,501, U.S. Patent Application 
Serial No. 09/169,072 filed October 9, 1998, U.S. Patent Application Serial No. 09/187,539 
30 filed November 6, 1 998, now U.S. Patent No, 6, 1 5 1 ,668, U.S. Patent Application Serial No. 
09/205,558 filed December 4, 1998, now U.S. Patent No. 6,173,389, U.S. Patent Application 
Serial No. 09/215,081 filed December 18, 1998, now U.S. Patent No. 6,101,592, U.S. Patent 
Application Serial No. 09/228,374 filed January 12, 1999 now U.S. Patent No. 6,216,223, 
U.S. Patent Application Serial No. 09/238,446 filed January 28, 1999, U.S. Patent 
35 Application Serial No. 09/267,570 filed March 12, 1999, U.S. Patent Application Serial No. 
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09/337,839 filed June 22, 1999, U.S. Patent Application Serial No. 09/350,191 filed July 9, 
1999, U.S. Patent Application Serial No. 09/422,015 filed October 21, 1999 entitled 
"Methods and Apparatus for Abbreviated Instruction and Configurable Processor 
Architecture", U.S. Patent Application Serial No. 09/432,705 filed November 2, 1999 entitled 
5 "Methods and Apparatus for Improved Motion Estimation for Video Encoding", U.S. Patent 
Application Serial No. 09/471,217 filed December 23, 1999 entitled "Methods and Apparatus 
for Providing Data Transfer Control", U.S. Patent Application Serial No. 09/472,372 filed 
December 23, 1999 entitled "Methods and Apparatus for Providing Direct Memory Access 
Control", U.S. Patent Application Serial No. 09/596,103 entitled "Methods and Apparatus for 
1 0 Data Dependent Address Operations and Efficient Variable Length Code Decoding in a 

VLIW Processor" filed June 16, 2000, U.S. Patent Application Serial No. 09/598,567 entitled 
"Methods and Apparatus for Improved Efficiency in Pipeline Simulation and Emulation" 
filed June 21, 2000, U.S. Patent Application Serial No. 09/598,564 entitled "Methods and 
S Apparatus for Initiating and Resynchronizing Multi-Cycle SIMD Instructions" filed June 21, 
}Jl 5 2000, U.S. Patent Application Serial No. 09/598,566 entitled "Methods and Apparatus for 
ifl Generalized Event Detection and Action Specification in a Processor" filed June 2 1 , 2000, 
fi and U.S. Patent Application Serial No. 09/598,084 entitled "Methods and Apparatus for 
y 1 Establishing Port Priority Functions in a VLIW Processor" filed June 21, 2000, U.S. Patent 
Application Serial No. 09/599,980 entitled "Methods and Apparatus for Parallel Processing 
^20 Utilizing a Manifold Array (ManArray) Architecture and Instruction Syntax" filed June 22, 
y[ 2000, U.S. Patent Application Serial No. 09/791,940 entitled "Methods and Apparatus for 
Q Providing Bit-Reversal and Multicast Functions Utilizing DMA Controller" filed February 

23, 2001, U.S. Patent Application Serial No. 09/792,819 entitled "Methods and Apparatus for 
Flexible Strength Coprocessing Interface" filed February 23, 2001, U.S. Patent Application 
25 Serial No. 09/792,256 entitled "Methods and Apparatus for Scalable Array Processor 
Interrupt Detection and Response" filed February 23, 2001, as well as, Provisional 
Application Serial No. 60/1 13,637 entitled "Methods and Apparatus for Providing Direct 
Memory Access (DMA) Engine" filed December 23, 1998, Provisional Application Serial 
No. 60/1 13,555 entitled "Methods and Apparatus Providing Transfer Control" filed 
30 December 23, 1998, Provisional Application Serial No. 60/139,946 entitled "Methods and 
Apparatus for Data Dependent Address Operations and Efficient Variable Length Code 
Decoding in a VLIW Processor" filed June 18, 1999, Provisional Application Serial No. 
60/140,245 entitled "Methods and Apparatus for Generalized Event Detection and Action 
Specification in a Processor" filed June 21, 1999, Provisional Application Serial No. 
35 60/140,163 entitled "Methods and Apparatus for Improved Efficiency in Pipeline Simulation 
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and Emulation" filed June 21, 1999, Provisional Application Serial No. 60/140,162 entitled 
"Methods and Apparatus for Initiating and Re-Synchronizing Multi-Cycle SIMD 
Instructions" filed June 21, 1999, Provisional Application Serial No. 60/140,244 entitled 
"Methods and Apparatus for Providing One-By-One Manifold Array (lxl ManArray) 
5 Program Context Control" filed June 21, 1999, Provisional Application Serial No. 60/140,325 
entitled "Methods and Apparatus for Establishing Port Priority Function in a VLIW 
Processor" filed June 21, 1999, Provisional Application Serial No. 60/140,425 entitled 
"Methods and Apparatus for Parallel Processing Utilizing a Manifold Array (ManArray) 
Architecture and Instruction Syntax" filed June 22, 1999, Provisional Application Serial No. 
1 0 60/165,337 entitled "Efficient Cosine Transform Implementations on the ManArray 

Architecture" filed November 12, 1999, and Provisional Application Serial No. 60/171,91 1 
entitled "Methods and Apparatus for DMA Loading of Very Long Instruction Word 
Memory" filed December 23, 1999, Provisional Application Serial No. 60/184,668 entitled 
=5 "Methods and Apparatus for Providing Bit-Reversal and Multicast Functions Utilizing DMA 
Jjfl 5 Controller" filed February 24, 2000, Provisional Application Serial No. 60/184,529 entitled 
fjl "Methods and Apparatus for Scalable Array Processor Interrupt Detection and Response" 
X filed February 24, 2000, Provisional Application Serial No. 60/184,560 entitled "Methods 
W1 and Apparatus for Flexible Strength Coprocessing Interface" filed February 24, 2000, 
0 Provisional Application Serial No. 60/203,629 entitled "Methods and Apparatus for Power 
J20 Control in a Scalable Array of Processor Elements" filed May 12, 2000, Provisional 

Application Serial No. 60/241,940 entitled "Methods and Apparatus for Efficient Vocoder 
O Implementations" filed October 20, 2000, Provisional Application Serial No. 60/25 1,072 

entitled "Methods and Apparatus for Providing Improved Physical Designs and Routing with 
Reduced Capacitive Power Dissipation" filed December 4, 2000, Provisional Application 
25 Serial No. 60/281,523 entitled "Methods and Apparatus for Generating Functional Test 

Programs by Traversing a Finite State Model of Instruction Set Architecture" filed April 4, 
2001, Provisional Application Serial No. 60/283,582 entitled "Methods and Apparatus for 
Automated Generation of Abbreviated Instruction Set and Configurable Processor 
Architecture" filed April 27, 2001, Provisional Application Serial No. 60/288,965 entitled 
30 "Methods and Apparatus for Removing Compression Artifacts in Video Sequences" filed 

May 4, 2001, Provisional Application Serial No. entitled "Methods and 

Apparatus for Generalized Event Detection and Action Specification in a Processor for 
Providing Embedded Exception Handling" filed June 15, 2001, Provisional Application 

Serial No. entitled " Modified Single Ended Write Approach For Multiple 

35 Write-Port Register Files" filed June 15, 2001, and Provisional Application Serial No. 
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entitled "Methods and Apparatus for Self Tracking Read Delay Write for 

Low Power Memory" filed June 15 5 2 001, all of which are assigned to the assignee of the 
present invention and incorporated by reference herein in their entirety. 

In a presently preferred embodiment of the present invention, a ManArray 2x2 iVLIW 
5 single instruction multiple data stream (SIMD) processor 100 as shown in Fig. 1 contains a 
sequence processor (SP) controller combined with a processing element-0 (PEO) to form an 
SP/PEO combined unit 101, as described in further detail in U.S. Patent Application Serial 
No, 09/169,072 entitled "Methods and Apparatus for Dynamically Merging an Array 
Controller with an Array Processing Element". Three additional PEs 151, 153, and 155 can 
10 be also labeled with their matrix positions as shown in parentheses for PEO (PE00) 101, PE1 
(PE01)151, PE2 (PE10) 153, andPE3 (PE11) 155. The SP/PEO 101 contains an instruction 
fetch (I-fetch) controller 103 to allow the fetching of short instruction words (SIW), also 
known as native instructions, or abbreviated-instruction words from a B-bit instruction 
s rJ memory 105, where B is determined by the application instruction-abbreviation process to be 

5 a reduced number of bits representing ManArray native instructions. If an instruction 
5 abbreviation apparatus is not used, then B is determined by the SIW format. The fetch 
5 controller 103 provides the typical functions needed in a programmable processor, such as a 
fj program counter (PC), a branch capability, eventpoint loop operations, see U.S. Provisional 
;^ Application Serial No. 60/140,245 entitled "Methods and Apparatus for Generalized Event 
120 Detection and Action Specification in a Processor" filed June 21, 1999 for further eventpoint 
T loop operation details, and support for interrupts. It also provides the instruction memory 
3 control which could include an instruction cache if needed by an application. In addition, the 
I-fetch controller 103 controls the dispatch of instruction words and instruction control 
information to the other PEs in the system by means of a C-bit instruction bus 102, which 
25 may include additional control signals as required by a particular implementation. C is 

determined by the implementation. For the exemplary ManArray coprocessor shown in Fig. 
1, C=32-bits. 

In the exemplary system 100, common elements are used throughout to simplify the 
explanation, though actual implementations are not so limited. For example, the execution 

30 units 131 in the combined SP/PEO 101 can be separated into a set of execution units 

optimized for the control function, for example, fixed point execution units in the SP, and the 
PEO, as well as the other PEs can be optimized for a floating point application. For the 
purposes of this description, it is assumed that the execution units 131 are of the same type in 
the SP/PEO and the PEs. In a similar manner, SP/PEO and the other PEs use a five instruction 

35 slot iVLIW architecture which contains a VLIW memory (VIM) 109 and an instruction 
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decode and VIM controller functional unit 107 which receives instructions as dispatched 
from the SP/PEO's I-fetch unit 103 and generates VIM addresses and control signals 108 
required to access the iVLIWs stored in the VIM. Referenced instruction types are identified 
by the letters SLAMD in VIM 109, where the letters are matched up with instruction types as 
5 follows: Store (S), Load (L), ALU (A), MAU (M), and DSU (D). The basic concept of 
loading the iVLIWs is described in further detail in U.S. Patent Application Serial No. 
09/187,539 entitled "Methods and Apparatus for Efficient Synchronous MIMD Operations 
with iVLIW PE-to-PE Communication". Also contained in the SP/PE0 and the other PEs is a 
common design PE configurable register file 127 which is described in further detail in U.S. 
1 0 Patent Application Serial No. 09/169,255 entitled "Method and Apparatus for Dynamic 
Instruction Controlled Reconfiguration Register File with Extended Precision". 

Due to the combined nature of the SP/PE0, the data memory interface controller 125 
must handle the data processing needs of both the SP controller, with SP data in memory 121, 
5 and PE0, with PE0 data in memory 123. The SP/PE0 controller 125 also is the controlling 
■iJ 5 point of the data that is sent over the 32-bit or 64-bit broadcast data bus 126. The other PEs, 
ffl 151, 153, and 155 contain common design physical data memory units 123', 123", and 
?i 123"' though the data stored in them is generally different as required by the local processing 
l=n done on each PE. The interface to these PE data memories is also a common design in PEs 1, 

2, and 3 and indicated by PE local memory and data bus interface logic 157, 157' and 157". 
W20 Interconnecting the PEs for data transfer communications is the cluster switch 171 various 
IJl aspects of which are described in greater detail in U.S. Patent No. 6,023,753 entitled 
O "Manifold Array Processor", U.S. Patent Application Serial No, 09/169,256 entitled 

"Methods and Apparatus for Manifold Array Processing", and U.S. Patent Application Serial 
No. 09/169,256 entitled "Methods and Apparatus for ManArray PE-to-PE Switch Control". 
25 The interface to a host processor, other peripheral devices, and/or external memory 

can be done in many ways. For completeness, a primary interface mechanism is contained in 
a direct memory access (DMA) control unit 181 that provides a scalable ManArray data bus 
1 83 that connects to devices and interface units external to the ManArray core. The DMA 
control unit 181 provides the data flow and bus arbitration mechanisms needed for these 
30 external devices to interface to the ManArray core memories via the multiplexed bus 

interface represented by line 185. A high level view of a ManArray control bus (MCB) 191 
is also shown in Fig. 1 . 

The present invention describes the methods used for VIM allocation and relocation 
of load VLIW statements taking into consideration the ManArray architecture, the VIM size 
35 of a specific ManArray processor core, the load VLIW latency, and knowledge of a 
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program's requirements. The ManArray instruction set architecture contains two instructions 
related to VLIWs, one that modifies the contents of a VIM line and one that executes a VIM 
line. These are the load VLIW (LV) and the eXecute VLIW (XV), respectively. 

Fig. 2A illustrates the instruction set encoding 200 for the LV. Fig. 2B illustrates the 
5 LV's syntax and operation description 210. The LV is used to load individual instruction 
slots of the specified SP or PE VLIW memory (VIM). The VIM address is computed as the 
sum of a base VTM address register Vb (V0 or VI) plus an unsigned 8-bit offset VIMOFFS. 
The VIM address must be in the valid range for the hardware configuration otherwise the 
operation of this instruction is undefined. Any combination of individual instruction slots 
1 0 may be disabled via the disable slot parameter 'D={SLAMD}', where S=Store Unit (SU), 

L=Load Unit (LU), A=Arithmetic Logic Unit (ALU), M=Multiply- Accumulate Unit (MAU) 
and D=Data Select Unit (DSU). A blank 'D=' parameter does not disable any slots. An 
instruction loaded into a slot marked by the disable slot parameter remains disabled when 
| loaded. The number of instructions to load are specified via the InstrCnt parameter. For the 
§l 5 present implementations, valid values are 1-5. The next InstrCnt(l-5) instructions following 
| LV are loaded into the specified VIM. An instruction loaded into a slot not marked by the 
1 disable slot parameter above is enabled when loaded. The unit affecting flags (UAF) 
|1 parameter T=[AMDN]' selects which arithmetic unit (A=ALU, M=MAU, D=DSU) is 
U allowed to set condition flags for the specified VIM when it is executed. 'F=N' specifies that 
S20 none of the arithmetic units are allowed to set condition flags. A blank T=' selects the ALU 
^ instruction slot. No arithmetic flags are affected by the LV execution and the instruction 
3 executes in a number of cycles equal to one plus the number of instructions loaded (instrCnt). 
* Fig. 3A illustrates an instruction set encoding 300 for the XV instruction. Fig. 3B 

illustrates the XV's syntax and operation description 310. The XV is used to execute an 
25 indirect VLIW (iVLIW). The iVLIWs that are available for execution by the XV instruction 
are stored at individual addresses of the specified SP or PE VLIW memory (VIM). The VIM 
address is computed as the sum of a base VIM address register Vb (V0 or VI) plus an 
unsigned 8-bit offset VIMOFFS. The VIM address must be in the valid range for the 
hardware configuration otherwise the operation of this instruction is undefined. Any 
30 combination of individual instruction slots may be executed via the execute slot parameter 
'E={SLAMD}\ where S=Store Unit (SU), L=Load Unit (LU), A=Arithmetic Logic Unit 
(ALU), M=Multiply-Accumulate Unit (MAU), D=Data Select Unit (DSU). A blank 'E=' 
parameter does not execute any slots. The unit affecting flags (UAF) parameter T=[AMDN]' 
overrides the UAF specified for the VLIW when it was loaded via the LV instruction. The 
35 override selects which arithmetic instruction slot (A=ALU, M=MAU, D=DSU) or none 
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(N=NONE) is allowed to set condition flags for this execution of the VLIW. The override 
does not affect the UAF setting specified via the LV instruction. A blank 'F- selects the 
UAF specified when the VLIW was loaded. Conditions flags are set by the individual native 
instruction in the slot specified by the setting of the "F— " parameter from the original LV 
5 instruction or as overridden by a "F=[AMD]" parameter in the XV instruction. Condition 
flags are not affected when "F=N'\ The XV instruction executes in a single cycle. 

Among its other aspects, the present invention adapts, generalizes and extends the 
concept of global code motion as described, for example, by Knoop et al., Optimal code 
motion: theory and practice, ACM Transactions on Programming Languages and Systems, 
10 Vol. 16, Issue 4, Pages 1117-1155, 1994, to include the highly novel ideas of VIM allocation 
and LV relocation. 

In order to better understand the novel approach to VLIW allocation in an indirect 
VLIW processor of the present invention, a different problem concerning register allocation 
Ci is first addressed. Register allocation is the scheduling problem of assigning machine 
'M 5 registers (physical registers) to program variables (soft registers). Program variables must be 
$P loaded into machine registers because in many computer architectures, the processor 
m execution units can only read and write their operands in registers. Since a processor has a 
small number of registers, and programs can contain a lot of variables, many variables have 
q to share the same physical register when their lifetimes do not overlap, thus the need for 
H 20 register allocation. The term "lifetime" refers to a program relative measure of time that a 
.U variable is actively used requiring its storage remain in a physical register of the processor, 
;-- = see, for example Appel, Modern Compiler Implementation in ML, Cambridge University 
Press, pp. 21 1-222 and 228-229, 1998. 

In a similar way, a group of instructions called a VLIW that can be executed 
25 simultaneously, has to be loaded into a VIM line by use of an LV instruction. Then, the 

contents of the VIM line can be executed multiple times by use of the XV instruction in the 
preferred ManArray architecture. Thus, VLIW instructions have to be allocated in VIM, 
loaded by an LV instruction to be used by the corresponding XV instruction. Two VLIW 
instructions can share the same VIM line when their lifetimes do not overlap or they use non- 
30 overlapping execution units. The lifetime of a VLIW is defined herein to extend from the 
node containing the LV that sets up the VLIW into a VIM line, till the node that uses the 
contents of the same VIM line with an XV for the last time in the program execution. The 
VLIW lifetime represents the program time the VLIW needs to remain in the VIM. It is 
impossible to calculate the lifetime of a VLIW in temporal terms (from cycle x to cycle y). 
35 Instead, according to the present invention, a static analysis of the program is performed and 
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the lifetime of a VLIW is defined in spatial terms with respect to the control flow graph of the 
program. 

To compute the lifetime of a VLIW established by an LV statement, in liveness 
analysis, a control flow graph (CFG) of a program is first calculated. Every node in the CFG 
5 is a basic block of the program and every edge is a jump or a call from one basic block to 
another. From the CFG, the VLIW flow equations are solved and a VLIW flow graph (VFG) 
is established. With the VFG, the VLIW interference can be determined and thus, the 
appropriate VLIW allocation to VIM can ultimately be determined. 
iVLIW Initialization Scheduling 
1 0 The indirect VLIW memory (VIM) is a critical resource for the ManArray DSP, just 

like other computer resources, for instance execution units and registers. iVLIW use permits 
faster program execution of sequences of instructions that can be operated in parallel and are 
repeated often. The penalty is a small overhead for setting up the corresponding VIM prior to 
~n use. 

J J] 5 The VIM setup for XVs can be lifted up in the control flow graph so that program 

ill sections that execute often do not have to re-initialize their VIM at every entry. However, the 
size of VIM is limited, so for programs using a large number of VLIWs, one cannot move all 
I Jl VIM initializations at an early set-up phase of a program execution, but rather must allocate 
H VIM use and distribute its initializations based upon the liveness analysis and program 
;f20 requirements. 

The problem of VIM allocation can be abstracted as follows: given the control flow 
^ graph (CFG) of a program, find the corresponding VLIW flow graph (VFG); from it build the 
VLIW interference graph (VIG); and color it. While the VIG can be colored, lift up the LV 
instructions on the CFG to program blocks that are executed fewer times, 
25 More specifically, the control flow graph is a directed graph G(N,E) where node N is 

a function or program block and edge e(ni,n2) from E is a jump or a function call from basic 
block ni to n2. The graph contains a special program-start node (with no parents) and an end 
node (with no descendants). 

Both nodes and edges can be augmented with run-time profiling data: integers that 
30 indicate how many times a block is executed, and how many times an edge (call or jump) is 
followed. It is also known how many cycles it takes to execute each program block once. 

Each block/function contains the loading and execution instructions of the i VLIWs it 
needs for best performance. See Fig. 4A for an example of a program section, functionA 
400, containing LV and XV instructions. 
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In this simplified example, LV instructions 402 and 412 load a set of instructions, 404 
and 414, respectively, at the VIM line denoted by the first and second argument of the LV 
instructions. For example, the instructions 404 are loaded into the VIM address specified by 
V0+0, the first and second arguments of LV instruction 402. XV instructions 420 and 422 
execute the contents of the VIM line that corresponds to their first two arguments. For 
example, XV instruction 420 executes the VLIW located in VIM at address V0+0, the first 
and second arguments of XV instruction 420. If functionA 400 is executed many times, as in 
a program loop, the load iVLIW instructions 404 for LV 402 and instructions 414 for LV 412 
can be moved to all the nodes that call functionA 400 because it is invariant between different 
function evocations. Fig. 4B depicts high performance XV execution code 450 
corresponding to 420 and 422 of Fig. 4 A that is repeated due to the split coding that results 
from moving the setup LVs to the caller node(s). As a result, the time for running functionA 
400 once, using Fig. 4B code, is reduced by 7 cycles and the time for running the callers of 
functionA 400 once increases by 7 cycles. 

If the code 450 of Fig. 4B functionA 1 is executed a proportional number of times more 
than its callers as in a loop, a faster running program is obtained. Obviously, it is not 
practical to push the load iVLIW instructions up all the way to the starting program block for 
a minimum execution time, since the number of iVLIW slots is bounded. Consequently, the 
load iVLIW instructions are distributed in such a way that at no time during the program 
execution, the number of VLIWs allocated to VIM exceeds the total VIM size. 

In order to allocate VIM lines to VLIW instructions used in a program, the liveness of 
each and every VLIW instruction used in a program is found. The life of a VLIW is defined 
to be the interval between the time a VLIW is defined via an LV instruction, until the time it 
is executed for the last time with an XV instruction. In a presently preferred embodiment, the 
liveness analysis is performed as follows. First, the control flow graph is calculated. This 
graph is a graph with nodes representing the basic program blocks. The graph identifies 
where program control enters at the top and it is guaranteed to exit at the bottom of a basic 
block. Connecting the nodes are edges denoting jumps and calls from one block to the other. 
The control flow graph is provided by a compiler, or it can be established by parsing 
specially annotated assembly code, where annotations provide the complete list of targets for 
all indirect control instructions, such as indirect jumps, EPLOOP boundaries, etc. From the 
control flow graph, the VLIW flow graph is then calculated by solving the VLIW flow 
equations. 

The VLIW flow equations are defined as follows. By architecture definition, an LV 
instruction defines a VLIW and an XV instruction uses a VLIW. For every node of the 
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control flow graph, there is a set D of the VLIWs that are defined in this node, and a set U of 
the VLIWs that are used in this node. The goal is to extract the sets I and O of live-in and 
live-out VLIWs respectively, at every node. The live-in VLIWs for a node "n" is defined by 
set I n , the set of VLIWs that are used in node "n" together with the VLIWs that are needed in 
5 successor nodes to this node except the VLIWs that are defined in node "n". The live-out 
VLIWs for a node "n" is defined by set On, the union of the live-in sets for all successor 
nodes to node "n". The sets I and O are determined by solving the VLIW liveness equations: 
In = U n u (O n ~D n ) ? and 

O n = u s i n SUCC ( n ) I s . The set I n of live-in VLIWs at node "n", is the union of the set U n of the 
1 0 VLIWs that are used in "n" and O n the VLIWs that live-out of "n" except D n the VLIWs that 
are defined in "n". The live-out VLIWs of node "n" are all the VLIWs that belong to the 
live-in sets of the successor nodes of "n". The notation u s m SUC c(n) Is denotes the union of all 
^ sets I s where s is a successor node to node n. 

=y The control flow graph with the live-in and live-out sets for each of the nodes 

Jfj 5 comprises the VLIW flow graph. The VLIWs that belong to the live-out set of a node, 
|?j cannot be assigned to occupy the same VIM line because they interfere with each-other. To 
f ji determine how to allocate the VIM lines, an interference graph is built as described below. 
^ 1 Every node of the interference graph corresponds to a VLIW. If two VLIWs belong to the 
O live-out set of the same node of the VLIW flow graph, then an undirected edge is inserted in 
~J20 the interference graph connecting the corresponding VLIW nodes. A successful allocation of 
H VIM lines to VLIWs corresponds to coloring the interference graph nodes in such a way that 
r: adjacent interference nodes are colored in different colors. Each color corresponds to a 
different VIM line. 

The above solution bears some similarities to whole program register allocation. A 
25 significant difference from register allocation is that the lifetime of a variable is imposed by 
the program. For VIM allocation, we can shorten the life of a VLIW by placing the 
initialization LV statement adjacently prior to the use of its corresponding XV statement. 

Two or more VLIW instructions with contents that require execution units that do not 
overlap will be referred to herein, as non-overlapping VLIWs. With the VLIW interference 
30 graph, it is easy to merge non-overlapping VLIW instructions, so as to share the same VIM 
line, thus possibly reducing the required size of VIM by a program. In principle, two non- 
overlapping VLIWs can be merged, even when their life-times interfere, because they require 
different execution units. The new VLIW is the union of the previous two, thus the same 
VIM line is used for both. The resulting VLIW interference graph has the nodes of the two 
35 original VLIWs coalesced in a new node, with edges the union of the edges of the replaced 
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nodes. However, the resulting VLIW interference graph might not be colorable with as many 
or fewer colors as the original graph because the new node has at least as many edges as the 
nodes it replaces. It is possible that a graph that was colorable with k colors prior to merging 
will become uncolorable with k colors after merging two nodes. It is our intention to only 
5 merge non-overlapping VLIWs whenever the colorability of the resulting VLIW interference 
graph does not worsen. This problem is NP-complete and only heuristics are available to 
determine "safe" merging. The heuristics from register allocation and move-instruction 
coalescing are utilized as discussed below. 

In a graph, let the degree of a node be defined as the number of edges a node has. On 
1 0 a k-colorable graph, a node is said to have a significant degree, if it is adjacent to k or more 
nodes. This definition is utilized to describe: 

(1) the Briggs heuristic: Two nodes can be merged, when the resulting node has 
fewer than k neighbors of significant degree. The graph after the merge remains k colorable, 
7"! if the original graph was k colorable. 

:f 5 (2) the George heuristic: Nodes a and be can be merged, if each adjacent node to 

^ a is either adjacent to b too, or it has fewer than k neighbors of significant degree. 
K ^e present invention is not limited to the above heuristics. Any other register 

J1 allocation and move-instruction coalescing heuristics are also applicable. Such coalescing 
: ft heuristics have been developed in other contexts to eliminate unnecessary move instructions, 
10 however, in the present invention the same heuristics are used in novel and advantageous 
y ways to reduce the VIM requirements of a program. One of the novel ways is that the 
:] coalesced VIM address holds two or more VLIWs. Other aspects are illustrated by the 
preceding and following discussion. 

Fig. 5 shows a simple program 500 written in pseudo-programming high-level 
25 language. The program consists of a single loop initiated by a statement 511. The body of 
the loop contains an unconditional statement 512 and a conditional statement 513 with two 
alternatives, statements 514 and 516. The program 500 specifies the execution of up to three 
VLIW instructions labeled as a, b, and c in statements 512, 514 and 516, respectively. 
Program statements 510 and 518 should be considered as the program prolog and epilog that 
30 bootstrap the program execution and return control to the operating system respectively. This 
present invention teaches how to optimally allocate the VIM lines to store the VLIWs a, b, 
and c and how to determine the positions of the LV instructions so that redundant loading of 
VLIWs is minimized. For this program, a very simplified VIM is assumed that can only hold 
up to two different VLIWs. 
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Fig. 6 shows a control flow graph 600 for the program 500 of Fig. 5. The nodes of the 
graph 600 correspond to the basic blocks of the program, in this case simple pseudo- 
programming statements, in the program listing 500 of Fig. 5. For example, node 611 labeled 
1 corresponds to basic block 1 of Fig. 5 that contains pseudo-programming instruction 511 
the entry point of the loop, instruction 512 the unconditional execution of VLIW a, and 
instruction 513 the evaluation of the conditional statement guard to determine whether 
control will go to node 614 labeled 2 or node 615 labeled 3. Note the back edge 620 from 
node 617 labeled 4 to node 611, labeled 1 is due to the loop defined by statements 5 1 1 and 
517. 

Fig. 7 shows control flow graph 700 corresponding to the control flow graph 600 of 
Fig. 6, but annotated with profile data 710 to 718 which indicates the number of times each 
node has been executed. For example, the given set of input data used to produce this 
profiling, the condition expression of statement 513 resulted to true 7 times and to false 3 
times during the 10 loop iterations. 

Fig. 8 shows a VLIW flow graph 800 corresponding to the control flow graph 700 of 
Fig. 7 but with the addition of the position of the XV instructions 512, 514 and 516 in nodes 
1, 2, and 3 indicated as entities 812, 814 and 816, respectively. VLIW flow graph 800 also 
displays an optimal placement of the corresponding LV instructions 822, 824 and 826 to 
nodes 0, 2 and 3 for a VIM with 2 lines. It is noted that if LV a 822 is placed together with 
its corresponding XV a 812, the LV statement will be executed 10 times instead of just once, 
thus increasing the total latency of the loop. 

Fig. 9 displays a VLIW interference graph 900 for the VIM allocation solution shown 
in Fig. 8. The lifetime of VLIW b 914 used in XV instruction 814 required by statement 514 
and VLIW c 916 of XV instruction 816 required by statement 516 partially overlaps with the 
lifetime of VLIW a 912 because VLIW a 912 is set-up outside of the loop 611-617. VLIW b 
914 and VLIW c 916 do not conflict with each other because they are defined and used in 
different branches 514 and 516 of the conditional statement 513-516. Nodes corresponding 
to VLIWs with overlapping lifetimes are connected with an edge denoting the interference, 
and the same VIM line cannot be assigned to VLIWs that interfere with each other. One 
approach to VIM allocation is accomplished by "coloring" the nodes of the interference 
graph of Fig. 9 with 2 colors, so that nodes connected with an edge do not share the same 
color. The interference graph 900 of Fig. 9 is colorable with 2 colors, thereby assigning VIM 
line zero to VLIW a 912, as one color, and VIM line 1 to VLIW b 914 and VLIW c 916, as 
the second color to both nodes. 
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With respect to given profiling data, an optimal placement of VIM initialization 
instructions involves calculating the total number of times each LV instruction is executed 
and moving LV instructions to a program region where they are executed fewer times. This 
movement may be successfully accomplished utilizing a greedy optimization algorithm that 
5 at each iteration moves the LV instruction that has the highest count of executions to a basic 
block that is higher in the control flow graph, with respect to call and jump edges, with a 
smaller count of executions. With such a move, the interference graph changes, it is therefore 
necessary to check whether it is still possible to allocate a VLIW instruction memory (VIM) 
address for each VLIW. 
1 0 The process 1000 shown in Fig. 10 is a steepest descent greedy LV relocation 

optimization process that iterates until no further improvement can be found. At every 
iteration, an LV instruction is chosen to be moved in step 1005. The movement criterion is 
the frequency of executions. Then, the LV is placed in a basic block that is closer to the 
f, program start node and the following conditions are met: the execution frequency of the new 
|5 node is lower and the VIM allocation succeeds in assigning a VIM line without exceeding the 
| maximum number of VIM lines, MaxVIM, is set by the hardware or application constraints. 
1 The process terminates when no further improvement can be achieved because either all LV 
¥■ statements have reached the program start basic block, or because any movement of an LV 

statement to a node with lower frequency results to an interference graph that cannot be 
HO colored with MaxVIM colors. 

= Specifically, process 1000 utilizes the flag variable "done" in steps 1001, 1002 1003, 

3 1010 and 101 1, to represent whether a full sweep across all LV instructions in step 1005 has 
* completed without being able to improve the total number of cycles spent by the execution of 

LV statements. Variable "Bestlmprovement" in steps 1004, 1007 and 1009 holds the 
25 reduction of cycles achieved by the move of an LV instruction from its current basic block 
node, to a basic block closer to the program start basic block. "Lvlist" in step 1005 is the 
global variable holding the list of pairs ("n","v") denoting that there exist an LV instruction 
on node "n" loading VLIW "v". "CurrentState" and "NewState" in steps 1006, 1008 and 
1012 are variables holding mappings of VLIWs to nodes. Software procedure MoveUp in 
30 step 1006 takes an LV instruction denoted by variable "Lvi" and the current state of LVs 

denoted by variable "CurrentState" and attempts to move "Lvi" to nodes higher in the control 
flow graph and reallocate the VIM according to the new position. If successful, the 
procedure MoveUp updates the global variable "Lvlist" and returns the new state of LV 
statements together with the reduction in execution cycles. Otherwise, it returns "NewState" 
35 assigned to "CurrentState" and improvement assigned to 0. Whenever "improvement" 
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exceeds "Bestlmprovement" in step 1007, the values of the best improvement found in the 
current sweep "NewState" and "improvement" are captured by the variables "BestState" and 
"Bestlmprovement" in steps 1008 and 1009, respectively. 

The starting state of the process 1000 can be one where all LV instructions are 
adjacently prior to their corresponding XV instructions. It is noted that this is usually the 
state returned by a compiler packing simple instructions into VLIWs. Alternatively, any 
other placement such as the state found in hand-written assembly programs can be the 
starting state. A heuristic allows a start from a state that can be much better off than an initial 
state where LV definitions are adjacent to XV uses and the VLIWs are VIM allocatable. One 
exemplary heuristic is the following: find the highest number C of LVs in the same basic 
block. Then, allocate the MaxVIM-C LVs of the highest frequency blocks and move them all 
for preloading to the program starting block. Then, use the rest C VIM lines for loading and 
use of the remaining unallocated LVs. This starting state is allocatable since it preassigns all 
VLIWs to VIM, but also is no worse than the elementary starting point, since MaxVIM-C LV 
instructions from the highest frequency basic blocks are executed just once. 

While the present invention has been disclosed in the context of various aspects of 
presently preferred embodiments, it will be recognized that the invention may be suitably 
applied to other environments and applications consistent with the claims which follow. 



